AMENDMENT AND RESPONSE UNDER 37 CFR § 1.111 

Serial Number: 10/579,048 
Filing Date: May 9, 2006 

Title: CREATING RESPONSES FOR AN ELECTRONIC PEN-COMPUTER MULTIMEDIA INTERACTIVE SYSTEM 

IN THE CLAIMS 

Please amend the claims as follows: 

1 . (Currently Amended) A computer implemented method of correlating pre 

existing traditional printed material to a response produced by a computer system comprising: 

providing a book consisting of one or more pages of printed material; 
definin g, using a computer system, an object on a digital p age image representing e f-the 
one or more pages of the traditional p rinted material; and 

linkin g, using the computer system, a position of the object on the digital p age image to 7 
aHd-a related response to be performed by the computer system, wherein the position of the object 
on the digital page image coiresponds to a physical position in the one or more pages of the pre 
existing printed material which is identified by the computer system when the book pre existing 
printer material has been placed in a printed material holder by a user, the printed material holder 
being coupled to the computer system, and wherein the position on the digital p age image is 
defined by a relative position of the book traditional printed material to a known physical location 
of the printed material holder. 

2. (Cuixently Amended) The computer implemented method of claim 1, wherein 
the response comprises at least one of rendering audio content, rendering video content, 
rendering image content, rendering text content, and performing an action by the computer 
system. 

3. (Currently Amended) The computer implemented method of claim 2, further 
comprising generating a multimedia database to store digital multimedia content including at 
least one of audio content, video content, image content, and text content; a printed material 
content database to store positional information about objects on the digital page images p ages 
and linkage information between the objects on the digital page images and at least one of the 
multimedia contents and actions; and an action library to store directives for actions to be 
performed on the computer system. 



Page 2 

Dkt: P17842 



AMENDMENT AND RESPONSE UNDER 37 CFR § 1.111 Page 3 

Serial Number: 10/579,048 Dkt: P17842 

Filing Date: May 9, 2006 

Title: CREATING RESPONSES FOR AN ELECTRONIC PEN-COMPUTER MULTIMEDIA INTERACTIVE SYSTEM 

4. (Currently Amended) The computer implemented method of claim 2, wherein 
defining the object on the digital p age image comprises using an electronic pen to outline 
boundaries of the object on the digital p age image . 

5. (Currently Amended) The computer implemented method of claim 2, wherein 
defining the object on the digital p age image comprises using an electronic pen to select key 
points on the boundary of the object on the digital p age image . 

6. ( Currently Amended) The computer implemented method of claim 2, wherein 
defining the object on the digital page image comprises using a mouse to manipulate a 
graphical object on a display to encapsulate the boundary of the object on the digital p age 
image as displayed on the display. 

7. (Currently Amended) The computer implemented method of claim 2, wherein 
defining the object on the page comprises using a mouse to select key points on the boundary of 
the object on the page as displayed on a display. 

8. (Cancelled) 

9. (Currently Amended) The computer implemented method of claim 2, wherein 
the one or more pages of p rinted material comprises material generated by a user. 

10. (Currently Amended) A non-transitory computer readable storage medium having a 
plurality of machine accessible instructions stored thereon, wherein when the instructions are 

executed by a processor, the instructions cause the processor to correlate pre existing traditional 
printed material to a response produced by a computer system by : 

defining define an object on a digital p age image representing a page of ^le-printed 
material wherein the page of printed material is included in a book consisting of one or more 
pages of printed material : and 

link a position of the object on the digital p age image to ^ -md-a related response to be 
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performed by the computer system, wherein the position of the object on the digital p age image 
corresponds to a physical position in the one or more p ages of the pre existing p rinted material 
which is identified by the computer system when the book p re existing printer material h as been 
placed in a printed material holder by a user, the printed material holder being coupled to the 
computer system, and wherein the position on the digital page image is defined by a relative 
position of the book traditional printed material to a known physical location of the printed 
material holder. 

11. (Previously Presented) The non- transitory medium of claim 10, wherein the 

response comprises at least one of rendering audio content, rendering video content, 
rendering image content, rendering text content, and performing an action by the computer 
system. 

12. (Currently Amended) The non-transitory medium of claim 11, further 
comprising instructions for generating a multimedia database to store digital multimedia 
content including at least one of audio content, video content, image content, and text 
content; a printed material content database to store positional infonnation about objects on 
the digital page images p ages, and linkage information between the objects on the digital 
page images and at least one of the multimedia contents and actions; and an action library to 
store directives for actions to be performed on the computer system. 

13. (Currently Amended) The non-transitory medium of claim 11, wherein 
instructions for defining the object on the digital page image comprise instmctions for 
using an electronic pen to outline boundaries of the object on the digital p age image . 

14. (Currently Amended) The non-transitory medium of claim 11, wherein 
instructions for defining the object on the digital page image comprise instructions for using 
an electronic pen to select key points on the boundary of the object on the digital p age image . 



15. (Currently Amended) The non-transitory medium of claim 11, wherein instructions 
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for defining the object on the digital p age image comprise instructions for using a mouse to 
manipulate a graphical object on a display to encapsulate the boundary of the object on the 
digital p age image as displayed on the display. 

16. (Currently Amended) The non-transitory medium of claim 11, wherein instructions 
for defining the object on the digital p age image comprise instructions for using a mouse to 
select key points on the boundary of the object on the digital p age image as displayed on a 
display. 

17. (Cancelled). 

18. (Currently Amended) The non- transitory medium of claim 11, wherein the one or 
more pages of p rinted material comprises material generated by a user. 

19. ( Currently Amended) An apparatus for associating a selected object on any pre 
existing printed material to a valid response provided by a computer system comprising: 

a pointing device to determine a position on the pre existin g a page of printed 
material wherein the page of printed material is included in a book consisting of one or more 
pages of printed material, wherein the pre existing printed materia l book is to be placed on a 
printed material holder by a user, and wherein the position on the pre existin g one or more 
pages of printed material is defined by a relative position of the printed material book to a 
known physical location of the printed material holder; 

a communicating device coupled to the printed material holder to transmit the position to 
the computer system; 

a maker component to define an object on a digital p age image representing a page of 
th e pre existing printed material; and to link a position of the object on the digital p age image 
to , and a related response to be performed by the computer system; and 

a player component to correlate the pointed position to selected content associated with 
the pre-existing printed material, the selected content being accessible by the computer system; 
and to provide a valid response to the user based at least in part on the pointed position and the 
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correlated content, wherein the valid response includes at least one of rendering audio content, 
rendering video content, rendering image content, rendering text content, and performing an 
action by the computer system. 

20. (Previously Presented) The apparatus of claim 19, wherein the pointing device 
comprises an electronic pen. 

21. (Currently Amended) The apparatus of claim 19, further comprising a 
multimedia database to store digital multimedia content, a printed material content database to 
store positional information about objects on the digital page images pages and linkage 
information between the objects on the digital page images and at least one of the multimedia 
contents and actions, and an action library to store directives for actions to be performed on the 
system. 



22. (Currently Amended) The apparatus of claim 19, wherein the pre-existing printed 
material comprises a traditional paper boo k material generated by a user . 



